Papers with generating text
Exploring Cross-lingual Text Detoxification with Large Multilingual Language Models. (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing methods of textual style transfer are monolingual i.e. designed to work in one exact language. |
| Approach: | They propose to make large multilingual models capable of performing multilingual style transfer without direct fine-tuning in a given language. |
| Outcome: | The proposed model can generate text in a given language without fine-tuning and is able to perform cross-lingual detoxification without direct fine- tuning. |
iTAG: Inverse Design for Natural Text Generation with Accurate Causal Graph Annotations (2026.acl-long)
Copied to clipboard
| Challenge: | Lack of causally annotated text data for use as ground truth hinders causal discovery . early template-based generation methods sacrifice text naturalness in exchange for high annotation costs . |
| Approach: | They propose a method which performs real-world concept assignment to nodes before converting causal graphs into text. |
| Outcome: | The proposed method shows high annotation accuracy and naturalness across extensive tests. |
Symbolic Planning and Code Generation for Grounded Dialogue (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models excel at processing and generating text and code, but lack a grounded task-oriented dialogue system that can handle grounding. |
| Approach: | They propose a modular and interpretable grounded dialogue system that integrates a reader and planner to convert partner utterances into executable code and a symbolic planner to determine the next appropriate response. |
| Outcome: | The proposed system outperforms the existing state-of-the-art on a one-common dialogue task and improves task success in human evaluations from 56% to 69% in the most challenging setting. |
Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for controlling the distribution of generated text only work with quantified distributions, which require pre-defined categories, proportions of the distribution, or an existing corpus following the desired distributions. |
| Approach: | They propose a few-shot human-in-the-loop training algorithm that allows distribution control for text generation via human feedback. |
| Outcome: | The proposed algorithm achieves state-of-the-art results on single topic/attribute and quantified distribution control compared to previous works. |
COFFEE: Counterfactual Fairness for Personalized Text Generation in Explainable Recommendation (2023.emnlp-main)
Copied to clipboard
Nan Wang, Qifan Wang, Yi-Chia Wang, Maziar Sanjabi, Jingzhou Liu, Hamed Firooz, Hongning Wang, Shaoliang Nie
| Challenge: | Personalized text generation (PTG) is a key component of our digital lives but can inadvertently associate different levels of linguistic quality with users’ protected attributes. |
| Approach: | They propose a framework to achieve measure-specific counterfactual fairness in explanation generation by focusing on one of the most studied settings: generating natural language explanations for recommendations. |
| Outcome: | The proposed framework achieves measure-specific counterfactual fairness in explanation generation. |
PIXAR: Auto-Regressive Language Modeling in Pixel Space (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent work shows the possibility of building open-vocabulary large language models that operate on pixel representations. |
| Approach: | They propose a pixel-based autoregressive LLM that performs generative tasks . they propose an adversarial pretraining stage that improves the readability and accuracy of PIXAR by 8.1 on LAMBADA and 8.5 on bAbI. |
| Outcome: | The proposed model performs free-form generative tasks while keeping the number of parameters on par with previous encoder-decoder models. |